Large-deviation Probabilities for One-dimensional Markov Chains Part 1: Stationary Distributions*
نویسندگان
چکیده
In this paper, we consider time-homogeneous and asymptotically space-homogeneous Markov chains that take values on the real line and have an invariant measure. Such a measure always exists if the chain is ergodic. In this paper, we continue the study of the asymptotic properties of π([x,∞)) as x → ∞ for the invariant measure π, which was started in [A. A. Borovkov, Stochastic Processes in Queueing Theory, Springer-Verlag, New York, 1976], [A. A. Borovkov, Ergodicity and Stability of Stochastic Processes, TVP Science Publishers, Moscow, to appear], and [A. A. Brovkov and D. Korshunov, “Ergodicity in a sense of weak convergence, equilibrium-type identities and large deviations for Markov chains,” in Probability Theory and Mathematical Statistics, Coronet Books, Philadelphia, 1984, pp. 89–98]. In those papers, we studied basically situations that lead to a purely exponential decrease of π([x,∞)). Now we consider two remaining alternative variants: the case of “power” decreasing of π([x,∞)) and the “mixed” case when π([x,∞)) is asymptotically l(x)e−βx, where l(x) is an integrable function regularly varying at infinity and β > 0.
منابع مشابه
Large-deviation Probabilities for One-dimensional Markov Chains. Part 2: Prestationary Distributions in the Exponential Case∗
This paper continues investigations of [A. A. Borovkov and A. D. Korshunov, Theory Probab. Appl., 41 (1996), pp. 1–24]. We consider a time-homogeneous and asymptotically spacehomogeneous Markov chain {X(n)} that takes values on the real line and has increments possessing a finite exponential moment. The asymptotic behavior of the probability P{X(n) x} is studied as x → ∞ for fixed or growing va...
متن کاملLarge-deviation Probabilities for One-dimensional Markov Chains. Part 3: Prestationary Distributions in the Subexponential Case∗
This paper continues investigations of A. A. Borovkov and D. A. Korshunov [Theory Probab. Appl., 41 (1996), pp. 1–24 and 45 (2000), pp. 379–405]. We consider a time-homogeneous Markov chain {X(n)} that takes values on the real line and has increments which do not possess exponential moments. The asymptotic behavior of the probability P{X(n) x} is studied as x → ∞ for fixed values of time n and ...
متن کاملExistence of Stationary Distributions for Finite - State Markov Chains
4.1 The Concept of Stochastic Equilibrium . . . . . . . . . . . . . . . . . . . . . . . . . . 1 4.2 Existence of Stationary Distributions for Finite-State Markov Chains . . . . . . . . . 3 4.3 Definitions and Simple Consequences . . . . . . . . . . . . . . . . . . . . . . . . . . . 5 4.4 A Test for Recurrence . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5 4.5 Proving Po...
متن کاملMixing Times with Applications to Perturbed Markov Chains
A measure of the “mixing time” or “time to stationarity” in a finite irreducible discrete time Markov chain is considered. The statistic η π i ij j m j m = = ∑ 1 , where {πj} is the stationary distribution and mij is the mean first passage time from state i to state j of the Markov chain, is shown to be independent of the state i that the chain starts in (so that ηi = η for all i), is minimal i...
متن کاملLarge Deviations and Full Edgeworth Expansions for Finite Markov Chains with Applications to the Analysis of Genomic Sequences
To establish lists of words with unexpected frequencies in long sequences, for instance in a molecular biology context, one needs to quantify the exceptionality of families of word frequencies in random sequences. To this aim, we study large deviation probabilities of multidimensional word counts for Markov and hidden Markov models. More specifically, we compute local Edgeworth expansions of ar...
متن کامل